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A SUMMARY OF THE EVALUATION 
- OF THE 1980-ai TITLE VII* 
PROJECT ESPERANZA 



Project Esperanza supplemented the basic special educatioh program 
for handicapped students with limited English proficiency (L.t.P. ) by 
providing (1) staff training and consultation, (2) materials develop- 
ment, identification, and evaluation, (3) assistance in the .diagnosis 
of educational needs and the prescription of instructional strategies, 
(4) direct individualization of instruction, -and. (5) outreach servites. 

• Durina 1980--81, the % prb$ram's inaugural year, 293 students were 
served injlo fej'ementary , ^intermediate, and secondary schools. Project 
sthf^{ Hncjuded^i' project 'director, coordinator, fbur resource special- 
ists', ;twp kdjjcat\qnal assi'stintfc, -two f ami ly assistant $, and an admin- ' 
.l^traitvV office 'aide. * * ,# * l f ' *' * 

y . ;Ttoe* analysis of data-f^pm pupil achie\7erfient measures,- program rec- 
ords/ and interviews' and ottee?vatWns- by* an Office of Educational Eval- p 
udtiWcorisultant,/lead to. the overal-1 contusion that Project Esperanza 
provided'an effective, cdmpreh.ensi v.e program of ' supplementary services ^ 
that' promoted the academic development of^handi-capped L.E.Pi students. ' 
. 'All of the pro.gram -objectives for pupTl achievement .were attained;, 
the proposed criterfa wete rfiet .iji English and ^Sparrish reading, Oral- 
English proficiency, mathematics, and, cultural heritage. The high school- 
sieve! population demonstrated larger .gains than the elementary or Giid- 
dle "school students in Spanish reacding, mathematics, and cultural her- 
itage; however, t|)e high school students also showed a higfi rate of tru- 
ancy. The elementary school students sK&wed significantly larger gains 
in oral-Engli%h prof iciency. than the middle or high school, students. 

The project" objective for teacher training was also attained, In 
response to participation jn teacher workshops, the classroom 'teachers 
demonstrated proficiency in developing individual instructional objec- 
tives as the focus^ofX d * ia g nostic -P rescri P t:i ve teaching approach. • 

- Despite repeated "and Varied efforts by project staff, the objective 
fqr parent involvement, was not attained, vlt is noteworthy, however, % 
£ijat relative t& majiy other projects- for similar populations, a moder- 
ate-degree of parent participation was achieved. Moreover,, project # 
staff demonstrated a sincer& desire to increase parent participation by 
eliciting the aid of the National Origin Desegregation "Assistance Center. 
/ \he following recommendations are aimed at improving. the overall ef- 
fectiveness of this meritorious program: . increase the number of /resource 
specialists and reduce their workload; develop. 'materials and tests yhich 
are appFopriat6 for the population; establish classes and place stu- 
dents at the 'beginning of the school year; and train classroom teachers 
on the effects *of code switching. . 
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,.>.' • I.. INTRODUCTION .• ' 

This'report presents the findings of the evaluation of the first .funding 
year of the E.S..E.A. Title VII program, Project Esperanza. This program pro- 
vided supplemental instruction, staff, training, resource assistance,, and out- 
reach services to support. the special education program for- handicapped Spanish 
speakiFig pupils with Hmited English proficiency (L.E.P.). 

Project Esperanza was designed to assist jthe Division of Special Education 
(D.S.E.) of 'the New York City- Public Schools in effectively meeting the educa- 
tional needs, of underserved L.E.P. studentv^ho we^fe previously served in non- 
bilingual special education or regular education classes. Population projec- 
tions based on a census by D.S.E. estimated that, by-- 1983, the" number* of Jiandi- 
capped L.E.P. 'students in the New York City Public Schools would increase to 
approximately. 10 thousand. To provide appropriate educational services for # 
this population, D.S.E. .marshalled efforts to identify these students and dra- 
maticafly increase the nurfiber of self-contained, bilingual, special education 
classes. Project Esperanza's mission was to provide comprehensive supplemen- 
tary services to assure the quality of -the expanding bilingual special educa- 
tion program. • ■ % • 

Project Esperanza was evaluated by the Office. of Educational Evaluation 
(0.E..E.) through the collection and analysis of data from (1) pupil achieve- 
ment tests,*(2) program "records of parent' participation and staff training*,, 
and (3) interviews and observations concerning the> level and quality of pro- 
gram implementation. The following chapters present 'tip findings of the eval- 
uation. Chapter U provides a description of the program and the evaluation 
•of program implementation; ChapteMII addresses* the Tevel of attainment of 
program objectives; and Chapter 'ivVesents conclusions and recommendations. 



' IT. EVALUATION OF PROGRAM IMPLEMENTATION 

■ DESCRIPTION - .- \ 

Project Esperariza supplemented the basic special education program for 
handicapped L.E.P. students by providing (1) staff training and consultation, 
(2) materials development, identification, and evaluation, (3) assistance 
in the diagnosis of educational needs and the prescription of instructional 
strategies, (4) direct individualization of instruction, and (5) outreach 
services. 

The basic educational program was provided in self-contained classes 

'_ f_z. ■ 

staffed by tax-levy teachers in the ratio of one teacfter to ITTtucfeTTts. 
The target population had never been served by D.S.E.'s other Title VII 
or Chapter 720 programs. They were either recently identified as handi- 
capped L.E.P. students or drawn from a waiting list. Program referrals 
were made by School-Based Support Teams*, Committees on the Handicapped,- 
special-class and crisis-intervention teachers, and school clinical staff. 

The pupil -centered objectives of the. program were focused upon gains in 
reading k in English and Spanish, mathematics, oral English-language competence, 
and cultural heritage. Other program objectives were to promote the involve- 
ment of parents* in the educational program and improve the instructional skills 
of classropm teachers. * 

The program was comprised of four principal components:' di rect pupil in- 
structionj resource services; staff * development; parent involvement; and out- 
reach servipes. The following sections present the findings of observations 
an* interviews conducted by .the O.E.E. consultant concerning the level of over- 
all program implementation and the quality of each component. 



LEVEL OF IMPLEMENTATION » \ { 

During the 1980-81 school year, Project. Esperanza served 293 students,! 
far below the estimated target population of 860. The proposal estimate was 
based on a *1979 D.S.E. census report and represented the pro-rated number of 
handicapped L.E.P. students Meeting the criteria for enrollment in bilingual 
special .education classes in September 1980. 'The attainment of the projected,, 
target population was hampered by (l).the process of referral, evaluation', 
and identification of eligible students, (2) the location of teachers quali- . 
fied in both bilingual and special education, "and (3) the location of suitable 
sites and the establishment of classes. The staggered opening of 'classes is 
indicated by the gradual increase in project enrollment during the school 
year:- the total target population numbered 52 in October, 181 in November, 
206"in January, 258 in February, 284 in March, and 293 in April'. Consistent 
with the reduction of the target population, the grant award was approximately 
ha\f of the amount orignally budgeted. 

.The project served 25 bilingual, special education classes in 20 schools 
located in Manhattan, the Bronx, Brooklyn, and Queens; the average- cla^s re- 
gister was 12. Sixteen of these classes were .establi shed prior io January 1 
1981; nine were introduced after this'-da.te. Although the program was designed 
to serve elementary, intermediate, and junior high schools, the actual target 
sites included four 'high schools and an Occupational Trafning Center.. 

The project staff, who were all funded under the Title VII grant, i,n- 
eluded: a project director, who- supervi sed and cooTtlinated the overall organi- 
zation and implementation of the program and was responsible for fiscal man- 
- agement; a project coordinator, responsible W assisting the project director 
in all aspect-s of program administration; four resource specialists, to assist 



the classroom teacher in instructional planning, materials identification and 
utilization/ and classroom instruction; two educationakassistants, who assis 
ted teachers. tn materials preparation and individual and small-group instruct 
tion of pupils; two fami ly^assistants, to provide outreach - services for the 
Students and thetr families; and an administrative, off ice aide for clerical^ 
support. The position of curriculunTspecialist Vnd one education assistant 
line remained vacant. All other staff were hired by. October 1981, with the 
exception of one resource, specialist, hired in Qecember 1981 1 and "the office 
aide, who began in June 1*31. • ' • - ' ■ 

DIRECT PUPIL INSTRUCTION ' . . «h 

' — * * 

The project 's'tw.o educational assistants provided the students with d*i r • 
rect instructional services. Their gdch was to enhance academic /devel opment * 
in both Spanish and English by assisting, in Jndtvidual aad small -group in- 
struction.- The educational assistants were intinerant, travelling to sites 
in Manhattan and the Bronx according\to a regular schedule. They served 
those classes that were, not served Jtfy tax-levy educational .assistants. In ~ 
addi tion to 'assisting in the^Tficfi visualization of instruction* the educa- 
^tional assistants participated in the development of instructional materials.* 

The importance of individualization of instruction to the educational, 
success of these students was apparent in the observations conducted by the 
O.E.E. evaluator. Within each class the students exhibited varying levels 
of bilingualism, i.e., proficiency in English and Spanish, and variance in 
academic skills. .Accordingly, individual and Small-group instruction was 
essential to meet the individual needsyof students. The trained educational 
assistants proved to be a vital asset to individualization. In this regard', 
» '* 



f , 

the resource specialist played a crucial role in traiqing and monitoring the 
activities of the .educational assistants, as -well as the'. classroom -teachers. 
(ThiS'.role*is described artd evaluated, in the next section of this report.) 
Observations revealed that, in most cases, the classroom environments were* 
carefully planned for individualized learning through the establishment of 
learning centers or a model identified as the "Workshop Way" approach -to 
classVoom Individual iza.ti on. An aesthetic, wel T-organized bulletinboard > 
containing material relevant to the, program contributed to a positive edu- 
cational atmosphere. Such bul letinboards di spl ayed. sa % mpl es of -each stu- t 
dent's work in both English and, Spanish, including creative artwork, posters, 
chart^, and calendars'. Classroom rules were posted in both languages. 'The. 
'stable^ .organized 9 and task-oriented atmosphere" in most classrooms provided ' 
a secure and comfortable learning environment with a minimum of distractions . 
which enabled many^of the hyperactive students to remain on task., 

D^.ily classroom instruction was provided in the major content areas out- 
l.ined "in the^program proposal, i .e. Spanish and English reading, oral-English 
proficiency, mathematics, and cultural heritage. The individualized classroom 
approach seemed *ef festive * in- maintaining the students' attention. Teachers * 
and paraprofessionals demonstrated effective classroom-management skills, as 
they guided the students through successive itftgrv^ls of 'i ndependent work, 
small-group instruction, full-class instruction, and playtime. During inter- 
views the staff indicated thafsuch pacing and alternation of instructional 
methods helped to sustain the students' learning. The instructional staff 
.demonstrated s^iM in systematic, multi-modality instruction,, i.e. , stimula- 
ting learning through several sensory modalities, including -tactile, kines- 
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varying the TOthods ^. ' • • ' "^"V^ning episodes and' , 

dff farences was und.^' •, accomodating individ/at ' 
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suitable for self-contained classes. 

Although the classes received an abundant supply of instructional materials, 
many of these were not consistent tfjjjh the cognitive and academic levels of 
the students. The heterogeneity in Skills of the target population necessi- 
tated the development- of teacher-made or -adjusted materials. The resource 
specialist trained both classroom teachers and educational assistants in. the 
development of instructional .materials that met the students 1 individual 
educational needs. 

The overall instructional approach observed in most cVassrooms was dia- 
gnpstic-prescriptive; that is the individual strengths and weaknesses of stu- 
dents were diagnosed through criterion- referenced testing with instruction 
prescribed accordingly. 

RESOURCE SERVICES T , - 

The resource specialist assisted, trained, and monitored the classroom 
teachers and- educational assistants. They played' an important role in pro- 
viding on-site instructional support. Along with the project director and 
coordinator, they made regular visits to the sites within. their region of 
responsibility to monitor classroom management and the educational process. 
'During these regular visits, the need for* materials wa^ assessed; As a 
result, most sites were well equipped with audioyisual and other teaching 
equipment such as the Bell and Howell Language faster, Spellbinder, calcu- 
lators, and various games and. kits needed* to maximize and extend cognitive/ 
academic learning experiences. , 

In addition, the resource specialist provided assistance in the admin4- 

strat'ion and interpretation of diagnostic tests, demonstrated methods of Jn- 

• ♦ 
" . -7- ' 



dividualizing instruction, and helped implement small-group instruction and 
special projects such as the successful art festival. Many hours were spent 
training the teachers in the administration of tests°'such as the Basic Inven 
tory of Natural Language (B.I.N.L.). The' resource' specialists encountered, 
in a few. cases, inexperienced classroom teachers who required more extensive 
training and monitoring due to their. lack of expertise in either bilinguaV 
education or special education methodology/ The resource teachers demonstra- 
ted experience and expertise in botii areas. 'All had taken, many courses~in 
bilingual' and special education, arid had extensive direct experience teach- 
t ing the target population. 

While the resource teacft^rs exhibited energy and initiative in helping 
the children receive the services proposed, their work load, which included 
several sites in the case of one«indi vidual, appeared to be burdensome. 
More resource teachers with experience and skill such as these are needed 
to further strengthen this component of the program. 

A 

STAFF DEVELOPMENT / • 

As already mentioned, the resource teachers were primarily responsible 
for day-to-day inservice- training of teachers and educational assistant. 

The project director ah'd coordinator also made frequent site visits and 

* / ' 

monitored inservice training and classroom instructional methods and tech- 

niques. Way* to improve teaching methods or curriculum'were dfscussed among 

V * 

the project di rector, coordinator, and resource teachers with' alternative 
strategies mutually planned. 

Acutely aware that this program served students, with a variety of handi- 
caps and cognitive/academic levels, the program administrators wisely empha- 



sized methods of individual . instruction in workshops which" were held for the 
educational assistants-, teachers, and resource specialists. These workshops 
were held bimonthly on Saturdays at Bank Street College in Manhattan. 

Other* inservice, workshops held during the year deaTt with areas critical 
to a successful educational program for the* target population: development 
of criterion- referenced tests in Spanish and English; deve"! opqent of curri- 
culum and materials in Spanish and English; and, ^il ingual and special educa- 
t-ion methodology. * ' 

Since this program 'focussed on developing both English and Spanish oral 
and written/communication skills, it was imperative that the- students 1 bilin- 
gualism was assessed. Teachers of bitingual handicapped youngsters needed 
♦to^kntiw precisely which literacy ski 1 H s the students -possessed in each lan- 
guage so that appropriate instructional- groups and I.E.P.'s cQUld be struc- 
tured. *In most cas.es, the-target population required further development of 
the four language skills in both languages: listening, speaking, reading, 

and writing. The instructional program used for developing literacy skills 

* - * 

in Spanjsh was designed around the results of assessment with the Leamos 

Diagnostic Test of Reading, while English-language instruction was based on 

assessment with an adaptation of the B.I.NiL. Accordingly, the teachers 

received extensive training in these- instruments. 

There is a paucity of commercial instructional materials in Spanish-lan- 

guage arts, English as a second language and math, for bilingual special ed 

ucation students. Accordingly, the classroom teachers and educational assis 

tants received training in materials adaptation and development. 
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Workshops which focus'-on developing functional -language assessment techniques 
eould further improve language instruction. 
PARENT INVOLVEMENT * 

Parent invotvement was promoted .through a series of workshops, a 
Parent Advisory Counct/, and the activities of family workers. Staff 
interviews and program records indicated that the efforts to secure pa- 
r rent-4w4l vement' were extensive. All parents were individually invited 
to attend the workshops through. letters, phoroe calls, and, where heces- * 
ho^e vis/its by family workers. Howev§^~ these efforts notwith- 
* standing, parent attendance was low, thereby precluding the effective- 
ness of the parent train.ing component (statistics are presented in Chap- 
ter III.) Moreover, although the parents expressed a receptive attitude 
toward the concept of apparent training program, participation in work- 
shops and -on the Parent Advisory Council remained low. Staff indicated 
thatwany parents were rel uctant to ge.t involved in program planning 
and that home problems took precedence over all other concerns. 

The sincerity of the staff's desire to promote parent jnvol vement 

/ : v . ; 

was manifested by their initiative in. consulting the National Origin^ , 
Desegregation Assistance Center (N.O.D.A.C.) for assistance in increasing ^ 
^parent participation. These contacts resulted in the launching of a two- 
year cooperative program by project staff and N.O.D.A.C. consultants de- 
signed to, bolster parent involvement in all aspects of bilingual educa- 
tion for the handicapped. 

In addition to prompting parent participation in the program, the . 
family workers provided outreach services 'by li'nking families' of pro* 



gram students with various sdcial agencies. The family; workers, who were 
supervised by a t^x-Tevy guidance counselor, received referral for fam- 

« 

ily intervention from classroom teachers, resource specialists, and prin- 
cipals. Most of these 'referrals involved health problems, truancy, , wel- 
fare assistance, or disciplinary problems. 
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. < . OF THE ATTAINMENT OF PROGRAM OBJECTIVES • ™ 

. SPefff ^"3 pup,, ad , W o S6Ve " objectives:' 

•■ • The f 0 „ owi „ g sectjo . Sk "' S ^Ponse to staff % , 

;—o. of eva)uat1on> ~ - ogives of th e ^ 

• • — * - c, ssroo „ data wre — - • 

r - * t-eachers on 0 f f ^ 

- Jlata were .eponed f 0 « 298 st '"'^l** <■«■ retried • • 

-e inc ^ lete ^ g? § J J-s Of theS e, acMe re .„t dati 

. " * PoP»-at f o,of 298) „ ere V rr0 "'" 9 ~ : » («-4 per- 

^ there " ! ~ 37 —t) were 

. „ ts _ ranged J - -ts (7 , 5 perce „ t) , ^ ^ 

( ^ ■ 3.3). App^e* J " 20 * - a 9 e * I2 . 9 

sOoo.s. 30.5 perce „ t ■' I?"' ^ "* StUde " tS f " 
«9» sOooU,, and 20 . 5 , • SCh00 ' S "-*-te^ dfate ^ 

• - h,9h schoo,s - °-p"W, Traf J g . 

^Proximately 4s • v% 

V teiy 46 percent 'of the «.•«.,, * *^ ' - ' 

diS ^*e serve. io „ ealth J " '-<.. 

as TO] lows* 9c _ 

25 perce "t mentally re . 



tarded;- 13 percent specific learning disabled; 11 percent emotionally 
> 

handicapped; nine percent educable mentally retarded; and four percent 
nearologically impaired and emotionally handicapped. 

AsMndicated in Chapter II, the students entered the program through 
out the project year. The number j*f££essions attended ranged from a min 
imum of 40 to a maximum of 172. 1W mean number of sessions attended, 
at the rate, of five sessions per week, was 103.9 ( S.D. = 33.3); the me- 
dian was 105.3 and>the mode was* 117. The mean percentage attendance was 
81 percent ( S.D. =20). • 

OBJECTIVE 1. ENGLISH-REA DING MASTERY 

An objective of Project Esperanza was to promote the mastery of 

ski 1 Is / in EngH^h reading by those students whp demonstrated the ability 

to profit from instruction . in EnglTsh as a second language. Specifi- 

t 

cally, the objective proposed that by June 15, 1981, "70 percebt <?f thg 

v ' , y 

participating students receiving .instruction in English, wilVfiave mas- 
tered four new reading objectives*, as measured by the Random House *Cri- 
terion Reading (C*.R.) assessment. The C.R. consists of short tests each 
measuring a .specific skill -in the areas of phonology', structural anal- 
ysis, and comprehension. ,^Test administration was ongoing, i.e., each 
student was tested immediately after instruction in a specific skill. 

To ascertain whether^the objective wa§ attained, a frequency distri- 
but ion was" constructed of the number of skills master^ by the students 
receiving English-Teading instruction. (See Table 1.) Of the 21 stu- 
dents ^who received instruction in English reading, 14 or 66.7 percent 



.TABLE 1 



FREQUENCY DISTRIBUTION OF 
THE MASTERY OF OBJECTIVES W 
ENGLISH READING 



Number of • Number of Relative - - Cumulative 

Objectives Mastered Students Percent ' Percent ' 

~, .'"5 '3 14.3 • 14.3 

4 > ii * 52.4 66. 7 b 



s 



6 



5- 6 28.6 95.3 



4*8 ' 100. 1 C 



21 



a Measured by the Random House Criterion Reading Test. 

b At least .four objectives were mastered by -66.7 percent of 
the students; the criterion ; f or the objective was 70 percent. 

c Exceeds 100 percent due to rounding error.. - 

.The observed percentage of students mastering at 
least four new skills, 66.7 percent, was not/signi- 
ficantly different from the proposed value, /70 per- 
cent (chi square = 0.10, df = 1, £ < *01). / Thus, . 
the objective v/as attainecT M I 

• • '\ 

J . f 
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attained the four-ski Tl criterion; the mode was four skills, mastered 

by moreithan 52 percent of the students. To determi.#e whether the ob- 

servecl percentage of students that attained the fourvsKtA criterion was 

significantly below the proposed value (70^ercent t ) , a single-sample * 

chi-square test was applied to the data. This ana-lysis indicate^ that* 

\ < 
the 1 observed frequency of students 'attaining the four-skill criterion 

did not differ significantly from the expected frequency under the pro- 
posed population parameter (70 percent). Accordingly, the objective for 
English-reading mastery was attained. t 

OBJECTIVE 2. SPANISH-READING MASTERY 

* o .-4 

«p4 • • • 

The program objective in Spanish reading stated that by June' 15,. 1981, 
70 percent of the participating students receiving instruction in Spanish 
will have mastered four objectives in Spanish reading. The objective, 
was measured through ongoing administration of the Spanish Developmental 
Reading Program (Leamo's). ' 1 m ' " ^ 

Table 2 presents the frequency distribution of the number of Spanishr 
reading- skilly mastered by program students.' Mastery ranged from a min- 
imum of one objective (one, student ) to a maximum of six objectives (nine 
students, or 4.3 percent* of the population). The mean, median, and mode 
were four objectives.- More than 88. percent of th^ 211 students for whom 
these data were submitted attained the four-skill criterion; this surpas- 
sed the proposed value of 70 percent. Accordingly, .the objective was, at- 
tained. ' k . ' . 



To measure the. relationship between program instruction and 'Spariish.- 
rWd^rigfsJcills mastery; a Pearson pro'duct-motiCnf correlation coefficient 



FREQUENCY DISTRIBUTE JJi^ . 
QF SPANISH-READING 'SKrcfe»«TERED 

BY PROGRAM STENTS?/- - \ > , 



6 



4 
3 



- ■ *« .ft 



. Number of ' Number of > # g^jj 8 

nhigctives Mastered Students < • Percent 

' q $v ; w ' 4.3 



c * 39 r 18 -? 



138 



65.4 



\i 3 • ' 6.2 



n . '* ' 5,2 



» 1 . - 0.5 



Measured by the Leamos Test^T Spanish Reading. 

b Exceeds-100 percent due to rounding error. 

c More than 88 percent of the, students mastered at 
least four new- skills; '^proposed value was 70 
percent. Thus, the obiecfive, was. surpassed. 



was computed between the number of objectives mastered and the number of 
program -sessions attended* The observed correlation was statistically 
significant (r- .50, j) < .01). Twenty-five percent* of the variance v in 
the number of Spanish-reading objectives mastered was accounted for by.' 
program attendance. 

to determine whether the program had a differential effect upon stu- 
dent mastery of Spani sh-readi ng* ski 1 Is by school level, the percentage 
of students attaining the four-skill criterion ms determined for the 

elementary, middle, and high school target populations. (See Table 3.) 

* • 
The highest percentage of criterion attainment was observed fqr the high 

„<$cho9l students: .all 39 students reached criterion. This finding is 

somewhat mitigated by the large percentage T( 18 percent) of Tiiflh school 

students omitted from thi s^analysis due to excessive absence and early m 

• 

program discharge. Eighty-seven percent of the students at %he % middle 

■ «. * 

school level and 81 percent otf thosfe at the elementary 'school level at- 4 

■* 

tained the criterion. Moreover; 100 percent of the objectives .mastered 
by the high school students were at the advanced level jof the fundamental 
stage of t fie Leamos. Approximately 2£ percent of the objectives mastered 
by the middle school students and only six percent of the objectives, for 
the elem'erttcfcy students 'were at the advanced stage. Seventy-seven per- 
cent and 74 percent respectively, were at the primary level of the fun- 
tiamental stage. # 

OBJECTIVE 3. ' MASTERY OF MATHEMATICS SKILLS. 

The mathematics objective of Project Esperanza stated that by June 15 

• # 

1981, 70 percent of the participating students will have demonstration * 



TABLE 3 



• 



RELATIVE PERCENTAGE OF STUDENTS WITHIN 
. • SCHOOL LEVEL THAT ATTAINED THE 
FOUR-SKILL CRITERION IH 
SPANISH READING 

LEVEL 3 . 



Mastered at least four 
skills 



ELEMENTARY 

,81% - 



MIDOLE b 
87% 



HIGH SCHOOL^ 
100%, 



Mastered fewer than 
four skills 



19% 



13% 



o%~ 



* a The numbers of students within level for. this analysis 
were as follows: 115 elementary, 73 middle ? and 39 
high school . « 

^Comprised of junior high and intermediate schools.. 

c Includes Occupational Trainirtg Centers. 
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mastery of four of the selected math objectives in which they were de- 
ficient in September 1,980, The objective was measured through ongoing 
administration of the diagnostic Mathematics Inventory (D.M.I.s). 

Table 4 presents a frequency distribution of the number mathematics 
skills mastered by the project students. Data were reported for 231 stu- 
dents. Mastery .ranged from a minimum of n<3 skills mastered (one student) 
to a maximum* of nine new skills j[one student). The mean was 4.2 and the 
median and mode were four skills. Over 74 percent of the students at- 
tained the four-skill criterion. Accordingly, the objective was accom- 
plished. — ^ 

Most of the skills that were mastered were operational including: 
addition of single-digit whole numbers; addition -with regroupi ru^rad 




di^ion of multiple-digit whole numbers; subtraction of whole numbers with 



0 

.and without regrouping; and the multiplication of whole numbers. Some 
of the skills mastered were in the functional areas of money, time* and 
temperature. * Two percent of the students mastered operations with frac,- 

tions. ' x . * r , 

There was a moderately strong relationship between the mastery of 
.^j^th skills and program attendance. 'The Pearson product-moment ^correla- 
tion coefficient between number of, skills mastered and number of sessions 
attended was statistically significant* (r = .56, £ < .01). The percent- 
age of shared variance was 31 -percent. Accordingly , "gains in mathematics 

skills appeared to b'e ~att ributarbl 6 to~ program attendance.* 

. • * * " * 

, Analyses' <cH& the percentage of students within school level that at- * 

tained the four-skill criterion (see Table 5) revealed a discrepancy^ be- 
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TABLE 4 



Number of 
lis Mastered 

9 

' , 8 




•5 

* * 

3 



FREQUENCY DISTRIBUTION OF THE. 
-NUMBER OF MATHEMATICS SKILLS 
MASTERED BY PROJECT STUDENTS 



Number of 
^udents 

• • 1 . 
4 

' 9 

' 26 

38 

93 ' • 
.27 • 

, • 27* - 



Relative 
Percent 

.OA, 
.. 1.7 

3,9 

a&. 3 

' 16. S" 

■ n 

• '.40.3 . 
1U7 

11.7 • 



Cumulative 
Percent 

0.4 



2.1 
6*.0 



17.3 



5 



33.8 
•74. 1 C 

* 

•85.8 
97. 5' 



«4< 



0.4' 



■1 ' 
T3T~ 



a Measured by the Diagnostic Mathematics In ye ntory. 

h *" 

Exceeds LOO pejrcent due to rounding error. 

c 0ver 74 percent of the students who received' ^ 
instruction in Spanish reading attained the 
. 1 four-Skill criterion; the proposed value of . 
70 percent wa*s surpassed-** , , *, 



4 99.7 



100. V 
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TABLE 5 
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" RELATIVE PERCENTAGE OF STUDENTS 
: - •• •« WITHIN SCHOOL LEVEL THAT ATTAINED 

THE FOUR-SKILL CRITERION. IN 
MATHEMATICS 












. ' - ELEMENTARY MIDOLE b 


HIGH SCHOOL 0 




/ • Mastered at least? '66% • ftn * 
« " four skills . 80% 


>7% 


- 


« 

Masterd'fewen than ' 34* * orM 
• four skills , " Z0% ' 


23% 




f Mgh school! elementary, 84 middle^and | 2 


•» 




• . Comprised of junior high and* intermediate schools. 






Includes Occupational Training Centers. 

* - e 


h 




• 

» / . ✓ 

# . t 

• 4 % * ^ - # 

*< •* e " 

* *. •* . * . * < 




r ' 

\ > 

** .* 
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'.■*'. * » 

• i 

V 1 


» • 






# 

» 

• • 
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fiFRir ♦ • ^ ^ 27 - 


• 

■» 


* .'A 



tween the elementary school students on the one hand, and the middle and 
high school students on the *other. The criterion was attained by 80 per- 
cent of the middle school students and 77 'percent of the high school stu- 
dents, but only 66 percent of the elementary students* . 

OBJECTIVE 4. ORAL-ENGLISH PROFICIENCY 



1 An objective oTTroject Esperanza"proposed that participating stu- 
den^s will demonstrate statistically significant growth (£ < .05) in 
oral English. The objective was measured by comparisons of Engl i shi-l an- 
guagfc sample^taken during the fall and springsemesters. The samples 
consisted of the students' oral-English productions in response to the 
presentation of pictorial stimuli that related to the program's curric- 
ulum. Stimuli were., presented individually until ten sentences were pro- 
duced. 'The average sentence length of these productions was scpred in 
A units /by a language-proficiency expert. The scoring technique was 



y adopted/ from the BU.N.L. The mean pre- and posttest scores wece com-. 
/ pared through attest for correlated samples. < 

Taple 6 presents a summary of the comparison of pre- and posttest 
Englislh-l anguage samples. The mean gain of 5.5 J units was statisti- 
cally significant^ = 3.67-, df = 330, £ <*.01). Accordingly, the ob- 
jective was_ met. - 
\ S To determine whether the gains in English-language scores differed 

* significantly among students grouped by school level, a one-way analysis 

• of covariance was applied to the posttest means by school level control- 
-lirig for differences in pretest means add sessions" attended. (See TaHe 7.) 
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TABLE 6 



COMPARISONS OF PRE- AND 
POSTTEST ORAL-ENGLISH 
LANGUAGE PROFICIENCY 
SCORES ' 



Test 
Session 



N 



Mean' 



s.a. 



PRE 
POST 



231 
231 



55.7 
61.2 



28.2 
25.1 



5.5 



3.67 



** 



** 



r £ < .01 



Scored in T units 



.The m6an pre- to posttest gain of 5.5 J units was 
significant beyond the .01 level. ~ 
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■ . TABLE 7 • 

ANALYSIS OF CO.VARIANCE FOR POSTTEST. 
ENGLISH-LANGUAGE SCORES BY -SCHOOL LEVEL- , 

5 - ■ '. ' ; 



Source of Variance 

Covariates 

Pretest Language. Score 
Sessions Attended 



D.F. 

1 
1 



M.S/ 

w 

53536.9 
4095.8 



153.7** 
11.7** 



Main Effect 



School Level 

Residual 

Total 



2 

213 
217 



3771.4 
348.2 
. 636.1 



10.8** 



** 



<£ < .01 

a The % covariates" were pretest scores and sessions attended. 

b * % 

Mean square j . r 



.After controlling for the effects of pretest scores and 
sessions attehded, the differences in mean posttest 
English -language proficiency scores among the three 
school levels.,, we re significant. 



9 



-24- 



30 



* 9 

A- significant main effect was obsejj^ed for school level (F = 10.8', df = 

2,21-3^ £ < ~.01); that is, significant overall differences were observed 

in 'lW adjusted mean posttest oral -English scores among students grouped 

by school level. To determine which specific school levels differed s^g- 

nificantly, post-hoc individual comparisons were applied to each^pair of 

adjusted posttest "means using the NewmanVeuls procedure. (See Table 8.) 

The adjusted posttest mean for the elementary students (M = 67.9) >was 

significantly higher, at : the '. Ok level , tfiari those for the high school 

and middle school students (M = 57.7* and *M = 55.1, respectively). The ; 

— ■ * — * 

adjusted means* for theMatter two groups did not differ significantly. 
Thus, the gains in oral-English proficiency demonstrated, by the elementary 
school students were significantly higher than those- shown by the mid- 
dle and high school students. 

OBJECTIVE 5. MASTERY OF CULTURAL HERITAGE CURRICULUM , 

• The -fifth pupil objective stated that by June 1981, 70 percent of 
the participating students will have demonstrated mastery of four objec- 
tives of the cultural heritage curriculum. This objective was measured" ^ 
by a locally-developed cultural heritage assessment instrument. This' % 
criterfojh-referenced instrument was designed to measure mastery of spe- 

t * , „£ 

cific skills in .four culturaUheritage curriculum arjsas: map skills, 

vocabulary /history , and holidays. In each of these areas four specific 

c 

skills were examined. (See Appendix.) Accordingly, the instrument was 
comprised of 16 Hems. # . Three levels of the test were, constructed^ pri- ' 

rtary, elementary, and intermediate. Th$ content validity of the instru- 

7 ' ■ ' 

•' : • • ' . ; • \ 
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TABLE 8 



INDIVIDUAL COMPARISONS 3 OF ADJUSTED 
'ENGLISH-LANGUAGE POSTTEST MEANS 
BETWEEN SCHOOL LEVELS 





4 


Middle 0 - 
School 


Hi gh d 
^School 


• 4 

Elementary 
School 

♦ 


I- 

V - 

* 


Mean's 6 


55.1 


' \ 57.7 ' 


67.9 - 


Middle Schools 


> 

55.1 




2.6 


12.8** 

* 


V* 

High School 


57*. 7 

* 






10. 2**< 


Elementary 
School 


67.9 


* » 







**£ < .01 

a Newman-Keu1s procedure. 

■* . ■ * 

b The numbers of students within school level were as 
follows: 106 elementary, 65 middle school, 47 high 
school . 

c Inclifded junioj high schools- and intermediate schools, 
included Occupational Training Centers. 

e Arfjusted for differences in pretest scores and sessions 
attended. 

.The adjusted gains in oral-English proficiency exhibited 
by the elementary school students were significantly 
'higher than those for the middle and hgh school students.. 

-.The latter two groups did not differ significantly. 



ment was -demonstrated by the judgment of program personnel and D.S.E, 
bilingual_staff that the items related to and throughly sampled the con- 
tent of the program's cultural heritage curriculum. Test administration 

wa§ ongoing. 

* ■" <■ 

Table 9 presents the f requency ( di stribution of the number of cultural 
heritage. objectives mastered by the, target population. Mastery ranged 
from a minimum of two skills (one student) to a maximum of ten skills 
(28 students or 12.1 percent of the population). The mean was 3.9 and 
the mode four. The criterion of four skills was attained by 95.2 per- 
cent of the students. Thus the proposed value of 70 percent .was sur- * 
passed. 

A plurality (37*percent) of the skills that, were mastered "were in 
the area of map skills; 27 percent, 19 percent, and 17 percent of the 
skills that were mastered were in the areas of vocabulary, history, and 
holidays, respectively. _ 

" Attendance was observed to affect mastery. The four-skill criteriorf 
was met by less thjan 73 percent of the students in the lowest quaftile 
of. the distribution Qf sessions attended; "all of the students in the high 
est quartile< attained the criterion. > - 

/ A difference in cuWural -heritage mastery was also observed by school 
level. The four-skill criterion was attained by all of the high school 
students but only 88 percent of the elementary students. Despite this 
difference, thfe program objective was met on all school levels, v : 





TABLE 9 
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FREQUENCY DISTRIBUTION OF THE 
NUMBER OF CULTURAL .HERITAGE 
OBJECTIVES MASTERED BY 
PROGRAM STUDENTS 




* % 

Number of 
Skills Mastered ' 


Number of 


* 

Relative 
Percent * 


Cumulative 
Percent 


10 


28 




12.1 "~ 


9 


12 


5.2 


17.3 ■ 


8 


15 


6.5 


23.8 


' • 7 


* 

16 . 


6.9 v 

. * 9 ' 


30.7 


6 


32 ' ' 


13.9 


44.6' 


c 
0 


58 


25.1 


' 69.7 




* 5? 


25.5 


95. 2 C 


* 3 


10 


4.3 


99.5 , • 


2 


1 


0.4 


' 99.9 b 




' .231 

** • 


• 


<r 


a Measured by locally-developed cultural heritage assessment 
instrument. , . 


b 0oes not 


sum to 100 percent due to rounding error; . 




^More thah 95 percent of the students tested mastered 
at least four skills; the proposed 'value of 70 per- 


9 



' * cent was surpassed. 



. - The, program ohjestK* fcxr-iparent invol vementTwas that by June, 15, 1*81, 
5J}'perceat of the. parentVof ^participating students will .have taken part in 
two activiti.es -for. parents. ' " 

Program- records were^ftafntaihed of all* parent activities-conaucted 
by*or promoted "by the program and the' level of parent participations TdTe 
parent activities conducted by the project include^ workshops, Parent Ad- 
visory Council meetings, luncheons, exhibitions of student work-, and in- 
dividual conferences to discuss pupil program's. 4 tn adcfi ti on, the project 
staff attempted to increase -parent 4nvolvemer& in mainstream school ac- 

tivities, such as open Iidus^* and special education activities, such as 

**** . \ 

individual educational* program (I.E. P.) conferences.' i? k 

Inspection of the program records indicated that the program conducted* 

a total of 13*separate activities for parents during the 1980-81 school 

year. The average parent attendance was five. Across all parent activ- 

ities, both program-conducted and program-promoted, a total of 82 parents - 

at least orfe attended ^representing 35 percent of the target students. 

However, only ten of these parents (four percent) attended more than one 

activity rwel 1 short 'of the criterion .of 50 percent. Accordingly, the 

/ ■ . • 

-objective was. not 'attained. * : 

* » * r 

OBJECTIVE 7. STflfr DEVELOPMENT ' , - , 

As part of its staff devel opment component, project personnel conduc- 
ted workshops for the tax-levy cl/ssroom teathers'to develop their skills 



in special and bilingual ^education. Th'e specifi-c objective of this com- 

ponent was that by June 15, 1981,, 80 percent of the participating teachers* 

v «. » » 

will have- demonstrated mastery of one teaching skill per training session. 

To measure ttiis objective", the goal of each training session was stated : 

as a performance- objective; that is the skill' tor be mastered was stated 

in observable, measurable terms with the conditions and criterion unam- 

biguosuly specified. Teacher mastery of these objectives was determined 

by the workshop leaders ^usually the project -coordinator or director) 

0 in an all-or-no'ne fashion. 

Project staff conducted four teacher-traniirfg workshops "between 

November 1980 and June 1981. The .mean atteqdance wa§ 13.5 teachers. 

The topics covered were as follows: instructional objectives;- instruc- 
* •> * * 

tional sequences; -task analysis; cmd objecti,v£$-bas6d instructional 

r e 

planning. As the topics^indifcate, the workshops focussed upon instruc- 
tional management and the diagnostic-prescriptive teaching approach. 

» t * ■ • 

A review of program records indicated that the, training abjective was 
mastered by 100 percent of the teachers fo£ three of v the four workshop^ 
13 of tiie 15 teachers on j84.-6 percent mastered the .objective far the 
fourth workshop. Overall, 96 perqent of the. teachers attending the four 
workshops mastered the individual training objectives. Accordingly, the 
objective criterion of 80 percent, was surpassed; # . . 



IV. CONCLUSIONS AND RECOMMENDATIONS 

• T.he analyses of clata from pupil achievement measures and program in- # 
terviews and observations lead to the overall conclusion that Project 
Esperanza, in' its first year of operation, has provided an effective, 
k comprehensive program of supplementary services that has promoted the 
academic development of handicapped L.E.P. -students.. 

All of the program objectives for pupil achievement were attained; 
. the proposed criteria were met in English and Spanish reading* ora\-Engl i sh 
proficiency, mathematics, and cultural heritage. The high school -level 
population demonstrated larger gains than the el ementary, or middle school 
.students in Spanish reading, ^mathematics, and cultural heritage; however 
the high schooT students also showed a high rate of truancy. The elemen- 
tary school students showed significantly larger gains in oral-English 

. proficiency than the "middle or high school students. ' ' , 

\ 

The project objective for teacher train-ing^was al so attained: In re- , 

sponse to participation in teacher workshops, the classroom teacheVV Vernon- . 

< *- 

strated proficiency in developing individual instructional objectives as 

the focus of a diagnostic-prescriptive teaching approach. 

Despite repeatKPand varied efforts by project staff, the objective- 

* for pargnt involvement was not attained.^ It- is noteworthy, however, that 

relative to many other projects for similar populations, a moderate de- 

gree of parent participation was achieved. Moreover, project staff demon- 

' strated a. .sincere desire to increase parent participation by eliciting s. 

the aid of N.O.D.A.C .0 " 

v • • • ' - 

a Observations and interviews reveal ed that program staff have success- 

fully met the challenge of individual izi ng. instruction for a heterogenous 

' -3.1- "'-».. • •'• , 

o ' % - m 
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population faced with the doubly burden of overcoming their physical, 
mental, and/or emotional handicaps and limited proficiency in English. 
Many of the teachers and paraprofessionals who provided direct service 

to students demonstrated initiative and competence in preparing or 

V 

• adapting special materials for instruction and in varying instructional 
techniques to suit the indivt^ual learner's needs. v — 
factor which hampered the efforts of program staff was the excessive 
workload of the resource specialists. Although the actual ratio between * 
the size of the the target population and the number of resource special- 
ists was lower than that which was proposed, the actual number and 'variety 
.of sites served was greater. Accordingly, the program needs more re- 

/source specialists in order to better train classroom teachers, especially 

I . ' ' ' . 

in the area of test diagnosis and interpretation, and educational pre- 4 

script ion. _ \\^J 

To enhance the sizable gains herein observed for the target popula 

tion, the following recommendations are offered. 

• Continue to recruit and, place qualified bilingual ^ 
special education teachers. , 

• Increase the* number of, resource specialists. These / 
staff play a critically important role" in training 
and assisting the classroom educators who need in- 
service training in specific teaching competencies. 

.Due to**tfe paucity of appropriate standardized 
test? and ijj2$erials for bilingual special educa- 
tion studeflrs,. future^project proposals should 
consider allocating funds for ttie specific purpose 4 - 
of identifying, adapting, or Areating appropriate 
curriculum materials and evaluation instruments. 

✓*.To facilitate program planning ,and enhance student, 
gains, D.S.E. should attempt to establish classes^ - 
and place students at the beginning of the school year. 



•Because of recurring questions as to the efficiency 
of the language, proficiency tests used by the pro- " 
gram, n*6w test^fand "procedures for measuring language 
development should be identified and standardized for 
special education students with limited English pro- 
ficiency. 

♦ 

tFinally^t is recommended that this meritorious 
program be refunded. - 




